Papers with MEMIT update
One Mask to Rule Them All: On Hidden Facts after Editing and How to Find Them (2026.findings-acl)
Copied to clipboard
| Challenge: | Knowledge editing methods such as ROME and MEMIT update factual associations by modifying MLP weights. |
| Approach: | They propose to use a mask to reverse edits by eliminating overattention in later layers . they also show that injecting the mask during editing drops editing success from 98% to 38% . |
| Outcome: | The proposed method reverses edits by eliminating overattention in later layers and drops editing success from 98% to 38%. |